Moment stability of stochastic processes with applications to control systems
نویسندگان
چکیده
We establish new conditions for obtaining uniform bounds on the moments of discrete-time stochastic processes. Our results require a weak negative drift criterion along with state-dependent restriction centered conditional process. They, in particular, generalize main result [22] which requires constant bound averaged one-step jumps The feature our make them suitable large class multiplicative-noise Under additional assumption Markovian property, we prove ergodicity that do not rely minorization condition typically needed ergodic theorems. Several applications to iterative systems, control and other dynamical systems multiplicative noise are included, these illustrative examples demonstrate wide applicability results.
منابع مشابه
Optimal Stochastic Control in Continuous Time with Wiener Processes: General Results and Applications to Optimal Wildlife Management
We present a stochastic optimal control approach to wildlife management. The objective value is the present value of hunting and meat, reduced by the present value of the costs of plant damages and traffic accidents caused by the wildlife population. First, general optimal control functions and value functions are derived. Then, numerically specified optimal control functions and value func...
متن کاملStochastic Control of Itô-lévy Processes with Applications to Finance
We give a short introduction to the stochastic calculus for ItôLévy processes and review briefly the two main methods of optimal control of systems described by such processes: (i) Dynamic programming and the Hamilton-Jacobi-Bellman (HJB) equation (ii) The stochastic maximum principle and its associated backward stochastic differential equation (BSDE). The two methods are illustrated by applica...
متن کاملMoment-linear stochastic systems and their applications
Our work is motivated by the need for tractable stochastic models for complex network and system dynamics. With this motivation in mind, we develop a class of discrete-time Markov models, called moment-linear stochastic systems (MLSS), which are structured so that moments and cross-moments of the state variables can be computed efficiently, using linear recursions. We show that MLSS provide a c...
متن کاملStochastic Stability Analysis and Control of Networked Control Systems with Multiple Markovian Processes
A novel stochastic system model with multiple Markovian processes for networked control system (NCS) is developed as a two chains Markovian jump linear system. By using an active sampling method, random time delays are reshaped into short time delays which are less than one sampling period such that the structure of the augmented discrete-time model becomes straightforward. Based on Lyapunov ap...
متن کاملStochastic Hybrid Systems with Renewal Transitions: Moment Analysis with Application to Networked Control Systems with Delays
We consider Stochastic Hybrid Systems (SHSs) for which the lengths of times that the system stays in each mode are independent random variables with given distributions. We propose an approach based on a set of Volterra equations to compute any statistical moment of the state of the SHS. Moreover, we provide a method to compute the Lyapunov exponents of a given degree, i.e., the exponential rat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematical Control and Related Fields
سال: 2023
ISSN: ['2156-8499', '2156-8472']
DOI: https://doi.org/10.3934/mcrf.2023008